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This article presents the Neo-Fuzzy-Neuron Modified by Kohonen Network (NFN-MK), an hybrid computa¬ 
tional model that combines fuzzy system techniques and artificial neural networks. Its main task consists in the 
automatic generation of membership functions, in particular, triangle forms, aiming a dynamic modeling of a 
system. The model is tested by simulating real systems, here represented by a nonlinear mathematical function. 
Comparison with the results obtained by traditional neural networks, and correlated studies of neurofuzzy sys¬ 
tems applied in system identification area, shows that the NFN-MK model has a similar performance, despite 
its greater simplicity. 


I. INTRODUCTION 


A traditional approach to Artificial Intelligence (AI) is known as connectionism , and its represented by the field of Artificial 
Neural Network (ANN). A second approach to AI is the symbolic one, with its various branches. Fuzzy Logic (FL) among 
them. ANNs models offer the possibility of learning from input/output data and its functionality is inspired by biological 
neurons. Normally, ANNs require a relative long training time and cannot be described as a mechanism capable to explain 
how its results were obtained by training. Therefore, some projects involving ANNs can become complex, also lacking strong 
foundations. On the other hand, the FL framework deals with approximate reasoning typical from human minds. It allows the 
use of linguistic terminology and common sense knowledge. The main limitation of this system consists in the nonexistence of 
learning mechanisms, capable of generating fuzzy rules and membership functions, which depend on the specialist knowledge. 

An interesting alternative consists of dealing with hybrid systems (HS), which use the advantages of both ANNs and FL. It can 
also employ the process model knowledge in order to decrease the duration of the project. In particular, HS are characterized by 
new architecture, learning methods, predefined parameters and knowledge representation, combining the fuzzy systems capacity 
of dealing with unprecise data and ANN ability in learning process by examples. 

This work proposes a hybrid system, called Neo-Fuzzy-Neuron Modified by the Kohonen Network (NFN-MK), applied to 
the context of function identification. The Neo-Fuzzy-Neuron (NFN) was originally proposed by Uchino and Yamakawa 01 
as an hybrid alternative model applied to real systems. The NFN-MK is an extension of NFN that uses a Kohonen Network to 
generate initial positions of triangular curves, that model the fuzzy neuron. 


II. DESCRIPTION OF THE MODEL 


The NFK-MK model is applied here in the context of function approximations, with the objective of adjusting membership 
functions for a neurofuzzy system, using Kohonen self-organizing map. The neurofuzzy model used is the Neo-Fuzzy-Neuron 
(NFN) developed by Yamakawa [till. This model was chosen for its short training time, compared to those typical from 
multilayer networks 0. 

The input functions in the system are supposed to be unknown, except by samples of data. The problem consists in determining 
a system in which the process output (yd) and the model process (y) become close together, according to a given criteria 
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In general we suppose that the process block shown in figure ^ is nonlinear. In general this implies in difficulties for the 
mathematical modeling. The NFN-MK model can be advantageously used in cases like this, without the necessity of linearizing 
techniques, unsuitable for some inputs. 



FIG. 1: Block diagram for the training phase of NFN-MK 

The proposed model consists in two main blocks as seen in figureQ included in the dashed box. One of them is the original 
Yamakawa’s NFN |7. s|. It works on triangular curves in its neuron fuzzy model, used for simplicity. In our model the NFN is 
extended by a classical application of Kohonen’s network @j. As shown in figure0ihere are two switches, used for the training 
process. 

When switch S 2 is open and Si closed, the Kohonen network works, looking for the central vertices of the triangular mem¬ 
bership functions. Initially these values are equally divided in seven fuzzy curves, which belong to the fuzzy neuron network. 
After this phase, the locations of the vertices are updated in the NFN block, where the base points are found by a new training. 

The training on the NFN block occurs when Si is open and S 2 is closed. The training proceeds like a backpropagation 
algorithm, finding the weights and base points of the triangular curves for each neuron. New points for these triangular curves 
represent rules such “ if-then ” like original idea of NFN. 

Here seven membership functions of triangular type are uniformly distributed in an interval [ x m ax , x m in] of input domain. 

The values of the membership functions are based in the experiments of Shaw et al. @|, which show that a change from five to 
seven triangular sets increases the precision in about 15%. There are no significative improvements for greater number of sets. 

We note that equidistant membership functions may not be convenient in situations where there are concentration of patterns 
in some regions and dispersion in others j(J. One alternative is to deal with function non-uniformly distributed. The adjustment 
of the membership functions can be made using a grouping algorithm, like Kohonen networks jj[0|. This is the main reason 
why we are using a very basic Kohonen network, that finds new positions of the vertices of triangular curves. In this method 
the network weights correspond to the values associated to the vertices of the triangular curves, and the number of neurons 
belonging to the processing layer corresponds to the number of fuzzy subsets for each NFN network input. The winner neuron 
is the one that corresponds to the shortest Euclidean distance from the input weight vector ii. 


III. EXPERIMENT 

A mathematical function that can be used as a benchmark is the Mexican hat , defined by 


. sinaqsina^ 

}{Xi 1 X2) = --• 

X1X2 

This function, shown in figure[2] represents the nonlinear system to be identified (cf. figure^. 

Here a; 1 G [10.0,-10.0] and X2 G [—10.0,10.0] are mapped to f(xi, X2) in the interval [—0.1,1.0]. 


( 1 ) 
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FIG. 2: Mexican hat function used as nonlinear system 

One reason for choosing this particular two-variable mathematical function for testing our system, is that the resulting 3D 
points can be easily visualized in a graphic. The points (xi, X 2 , f(x 1 , X 2 )) are used for training of Kohonen network and also 
for adjusting the weights in NFN (cf. figure[T|. 

Initially, the seven membership functions, showed in the figure 0 are equally distributed in the domain. The vertices as their 
limits, right and left, are complemented by three first columns in table U 



Range of inputs 

FIG. 3: Initial membership functions 


The curves in figure 0 represent the initial state of neurons in NFN, which are seven for each input x, (xi and X 2 ). The 
semantic values of these curves are summarized in table HU where the notation is the usual one from fuzzy logic (FL) systems. 

The next step consists in finding new vertices using a very basic Kohonen network. These new vertex values are presented in 
the table|T| (vertex column). This phase is computed with S 2 switch open and Si closed (cf. figure^. 

Once new vertices are found, the triangular curves are redrawn in according the clustering in each two curves. These curves 
are built to keep the convexity, in the sense that the summation is 1 for each two curves. For example, if hze{x) = 0.37, its 
neighbour curve in right side has the complement /rps(x) = 0.63. By making these adjustments we are following the idea of 
clustering exhibited in the Kohonen network. Therefore, the new left and right limits for these triangular curves are found. 

Since the function|2]is symmetric in the two variables, the vertex positions in the triangular curves are equally distributed. In 
this case, the NFN model presents fourteen fuzzy neurons, seven for each variable (xi and ./• 2 )■ 
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Range of inputs 

FIG. 4: New membership functions adjusted by NFN-MK 

By closing switch S 2 and opening <Sj (cf. figure^, the adjustment of weights in the NFN model follows. The NFN model is 
trained with 225 patterns of input/output (xi,X 2 , /(.i'i. 2 )) equally distributed, during 10 epochs. The new results are presented 
in table|T| and the new values of the weights in NFN (cf. figure 0 are showed in last two columns of table |T] The names of the 
fuzzy curves are defined in table UTI 


Fuzzy Curves 

Initial Values 

New Values 

Left 

Vertex 

Right 

Wl,2 

Left 

Vertex 

Right 

W )inal 

tfinal 

NL 

-10.0 

-10.0 

-6.67 

1 

10.0 

-10.0 

-3.5 

0.0715 

-0.0643 

NM 

-10.0 

-6.67 

-3.33 

-10.0 

-3.5 

-0.2 

-0.1414 

0.0103 

NS 

-6.67 

-3.33 

0.0 

-3.5 

-0.2 

3.2 

0.5154 

0.4973 

ZE 

-3.33 

0.0 

3.33 

-0.2 

3.2 

6.5 

-0.0824 

0.0321 

PS 

0.0 

3.33 

6.67 

3.2 

6.5 

10.0 

0.0143 

0.1714 

PM 

3.33 

6.67 

10.0 

6.5 

10.0 

10.0 

0.0739 

-0.0463 

PL 

6.67 

10.0 

10.0 

10.0 

10.0 

10.0 

0.0 

0.0358 


TABLE I: Parameters for the Mexican hat function 


NL: Negative Large 
NM: Negative Medium 
NS: Negative Small 
ZE: Zero 
PS: Positive Small 
PM: Positive Medium 
PL: Positive Large 

TABLE II: Semantic meanings of fuzzy curves 


The symbols Wj inal and w 2 inal denote the average weights of NFN model, considering each fuzzy neuron already modified 
(cf. figure^. Such values correspond the following vectors: wj inal = [w\, w\, ,..., w[] and w 2 inal = [w\ , w 2 , w 2 ,..., w 7 2 \. 

Here w\ = lull, ..., w[ = wl7, w\ = w 21,..., w 7 2 = w27 , etc. 
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FIG. 6: Mexican hat function obtained by NFN-MK 


NL 



The resulting sum gives 


f(xi,X 2 ) = fJhn(xi)w m + mm+l){xi)W( m +l) + Hn(x 2)w„ + H(n+i) (x 2 )W( n+1 ) . (2) 

Expression <□ follows the original idea of Uchino and Yamakawa on , where the membership functions are complementary. 
Thus, the indices m and m + 1 are associated to a desfuzzyfication into two complementary curves. The same idea is applied to 
n and n + 1 indices. A numerical evaluation of the equation o, is given table[]] The graph in tig lire 0 c an be easily computed 
for any pair of (xi, x 2 ). 


IV. EVALUATION OF THE PERFORMANCE 

The NFN-MK is trained with 225 samples during 10 epochs, so the internal parameters become determined (neural weights 
and triangular curves of these neurons). After this some inputs are given. The results of these tests are shown in the figure [6] 
Here the points denoted by + represent the simulation results. The continuous line represents the actual function. 
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The values for the training (225 samples and 10 epochs) as well as the model selected (Mexican hat function), were chosen 
in order to compare our results with those found elsewhere. The parameters chosen were provided in these references, except 
by the ANN model that uses a classical backpropagation algorithm with 2 neurons as input layer, 7 other in hidden layer, and 1 
in output layer. The parameter considered is the number of mathematical operations necessary to evaluate a cycle (an epoch), 
for each neuron model in its respective architecture. As an simplification, the multiplication, sum and subtraction operations 
are associated to the same value. These results are shown in table dU They show that the NFN-MK performance is equivalent 
to that of other models used to identify the same curve. Although our system presented a mean quadratic error (MQE) slightly 
greater than those obtained by NFHQ (Neuro-Fuzzy Hierarquic Quadtree) and FSOM (Fuzzy Self-Organized Map) models, it is 
much simpler in what concerns mathematical operations. On the other hand, the NFN-MK presented a much smaller MQE than 
the classical ANN. 


Models 

Number of Operations (+,—, x) 

Operations by function 

MQE 

NFN-MK 

8 

2 

0.0426 

NFHQ 

168 

21 

0.0150 

FSOM 

200 

101 

0.0314 

NN 

42 

8 

0.1037 


TABLE III: Model comparisions 


V. CONCLUSION 

The objective of this work was to extend a NFN model that allowed the adjustment of membership functions of triangular 
type by the method of Kohonen. The result was the proposal of the Neo-Fuzzy-Neuron Modified by a Kohonen Network (NFN- 
MK). The model was successfully tested in function approximation, and its performance was similar to those obtained by more 
complex, classical neural networks. 

The obtained results do not allow inferences about the generality of the NFN-MK model, but they seem to indicate that we 
have a viable model for system identification. What makes this model particularly interesting is the relatively reduced number 
of operations and function calculations involved, implying small processing times, when compared to other ANNs 
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